Method and system for video transmission and processing with customized watermarking delivery

ABSTRACT

Methods and systems for video transmission and processing with customized watermarking delivery are disclosed and may include watermarking data at a communication device utilizing received global positioning (GPS) data and communicating the watermarked video data to a receiving communication device. The receiving communication device may verify the watermarked data, and may determine whether to render the received watermarked data based on the verification. The communication device may include an edge device, and may receive a feedback signal communicated from the receiving communication device. The watermarking of subsequently processed data may be adjusted based on the received feedback signal, which may include GPS data and/or device parameters corresponding to the receiving communication device. The watermarked video data communicated to the receiving communication device may be adjusted based on one or more device parameters corresponding to the receiving communication device and/or GPS information.

CROSS-REFERENCE TO RELATED APPLICATIONS/INCORPORATION BY REFERENCE

This application makes reference to and claims priority to U.S.Provisional Application Ser. No. 61/101,849 filed on Oct. 1, 2008, whichis hereby incorporated herein by reference in its entirety.

FEDERALLY SPONSORED RESEARCH OR DEVELOPMENT

[Not Applicable]

MICROFICHE/COPYRIGHT REFERENCE

[Not Applicable]

FIELD OF THE INVENTION

Certain embodiments of the invention relate to digital media protection.More specifically, certain embodiments of the invention relate to amethod and system for video transmission and processing with customizedwatermarking delivery.

BACKGROUND OF THE INVENTION

Communication systems provide several options for obtaining access tobroadcast video content. Consumers may receive broadcast standarddefinition (SD) and high definition (HD) television broadcasts from theair with an antenna. Analog and digital cable television networksdistribute a variety of television stations in most communities on asubscription basis. In addition, satellite television and new internetprotocol (IP) television services provide other subscriptionalternatives for consumers. Analog video signals may be coded inaccordance with a number of video standards including NTSC, PAL andSECAM. Digital video signals may be encoded in accordance with standardssuch as Quicktime, (motion picture expert group) MPEG-2, MPEG-4, orH.264. In addition to digital coding, some video signals are scrambledto provide access to these signals, only to the subscribers that havepaid to access the particular content.

The desire for video content has driven cellular telephone networks tobegin offering video programs to their subscribers as streaming video.In this fashion, users of mobile devices may have access to videoprogramming on the go. Some of the techniques used in providingbroadcast video content to stationary devices are not suitable foradaptation to the viewing environment associated with a handheld mobiledevice.

Watermarking is a technique utilized to protect digital media fromunauthorized use or illegal copying, such as with copyrighted material,for example. Watermarking of digital media may fall into two categories:visible or invisible. Visible watermarks are typically added to digitalimages to indicate ownership and to thwart unauthorized use of theimages. The watermark may comprise the identity of the owner and/or acopyright symbol and date, for example. This type of watermark may beconsidered a spatial watermark in that the data is embedded spatially inan image, and the watermark signal is distinct from the original imagedata. Spatial watermarks may not be robust against attacks due to theability of filtering, removing and/or cropping the data.

Invisible watermarks do not change the image to a perceptible extent.This may be accomplished by minor changes in the least significant bitsof the original data. Watermarks that are unknown to the end user may bedesignated as steganographic watermarks.

A watermarking process may embed the data in the frequency domain,making it more robust against attack. The technique may be analogous tospread spectrum encoding in communications, where the data to beembedded may be spread over a multitude of frequencies by modulating thewatermark signal with pseudo-noise before adding it to the originaldata. The low signal amplitude, due to the watermark being invisible,the large bandwidth of the original data (image or video, for example),and the shortness of the watermark message, are all factors thatindicate spread spectrum encoding is a logical choice.

In addition to embedding a watermark in digital multimedia data,detecting whether a watermark is present may also be important in theprotection of multimedia data. Multimedia players may include watermarksensing electronics to preclude the use of unauthorized or piratedmedia.

Further limitations and disadvantages of conventional and traditionalapproaches will become apparent to one of skill in the art, throughcomparison of such systems with the present invention as set forth inthe remainder of the present application with reference to the drawings.

BRIEF SUMMARY OF THE INVENTION

A system and/or method for video transmission and processing withcustomized watermarking delivery, substantially as shown in and/ordescribed in connection with at least one of the figures, as set forthmore completely in the claims.

Various advantages, aspects and novel features of the present invention,as well as details of an illustrated embodiment thereof, will be morefully understood from the following description and drawings.

BRIEF DESCRIPTION OF SEVERAL VIEWS OF THE DRAWINGS

FIG. 1 is a block diagram of an exemplary video network, in accordancewith an embodiment of the invention.

FIG. 2 is a block diagram of an exemplary video network, in accordancewith another embodiment of the invention.

FIG. 3 is a block diagram of an exemplary video processing system, inaccordance with an embodiment of the invention.

FIG. 4 is a block diagram of an exemplary video processing system, inaccordance with another embodiment of the invention.

FIG. 5 is a block diagram of a mobile video device, in accordance withan embodiment of the invention.

FIG. 6 is a block diagram illustrating a watermarking system in a mobilevideo device, in accordance with an embodiment of the invention.

FIG. 7 is a flow diagram of an exemplary video transmission andwatermarking process, in accordance with an embodiment of the invention.

DETAILED DESCRIPTION OF THE INVENTION

Certain aspects of the invention may be found in a method and system forvideo transmission and processing with customized watermarking delivery.Exemplary aspects of the invention may comprise watermarking data at acommunication device utilizing received global positioning (GPS) dataand communicating the watermarked video data from the communicationdevice to a receiving communication device. The receiving communicationdevice may verify the watermarked data. The receiving communicationdevice may determine whether to render the received watermarked databased on the verification. The watermarked data may comprise multimediainformation comprising voice, video and/or text information. Thecommunication device may comprise an edge device. The receivingcommunication device may comprise a wired and/or a wirelesscommunication device. The communication device may receive a feedbacksignal communicated from the receiving communication device. Thewatermarking of subsequently processed data may be adjusted based on thereceived feedback signal. The feedback signal may comprise GPS dataand/or device parameters corresponding to the receiving communicationdevice. The device parameters may comprise one or more of: a powerstate, a device resolution, a screen size and a display setting of thereceiving communication device. The watermarked video data communicatedto the receiving communication device may be adjusted based on one ormore device parameters corresponding to the receiving communicationdevice and/or GPS information corresponding to the receivingcommunication device. The communication device may transcode datacorresponding to the watermarking from a first format to a secondformat.

FIG. 1 is a block diagram of an exemplary video network, in accordancewith an embodiment of the invention. Referring to FIG. 1, there is showna video network 101 comprising a video source 100, a network 102, awireless access device 104, an edge device 105, and a mobile videodevice 110. There is also shown video content 106, a video stream 107, avideo signal 109, and mobile device feedback 112.

The network 102 may comprise equipment comprising suitable logic,circuitry and/or code that may enable transport and/or distribution ofmultimedia content. In this regard, the network 102 may comprise adedicated video distribution network such as a direct broadcastsatellite network or cable television network that may enabledistribution of video content 106 from a plurality of exemplary videosources, such as the video source 100, a plurality of wireless accessdevices and optionally wired devices over a wide geographic area. Inanother embodiment of the invention, the network 102 may be aheterogeneous network that may comprise one or more segments of ageneral purpose network such as the Internet, a metropolitan areanetwork, wide area network, local area network or other networks such asan Internet protocol (IP) television network, for example.

The wireless access device 104 may comprise suitable logic, circuitryand/or code that may enable access to a network by a subscriber device.In this regard, the wireless access device 104 may comprise a basestation or access point that may provide video content 106 to aplurality of video subscribers over a cellular network such as anUniversal Mobile Telecommunications System (UMTS), enhanced data ratesfor GSM evolution (EDGE), 3G, 4G or other cellular data network, awireless local area network (WLAN) such as an 802.11a, b, g, n, WIMAX,or other WLAN network. In an exemplary embodiment of the invention, thewireless access device 104 may comprise a home gateway, videodistribution point in a dedicated video distribution network or otherwireless gateway for wirelessly transmitting the video content 106,either alone or in association with other data, signals or services, tothe mobile video device 110.

The edge device 105 may comprise suitable logic, circuitry and/or codethat may provide exemplary functions such as multimedia contentdistribution, routing and/or switching. In this regard, the edge device105 may comprise a server and/or router, such as an edge router, switch,hub, gateway device or other network module that may receive a videostream 107 that may contain the video content 106. The edge device 105may be enabled to process the video stream 107 to produce a video signal109 for transmission to the mobile video device 110. In an exemplaryembodiment of the invention, the edge device 105 may receive mobiledevice feedback 112, which may comprise a device parameter, power state,measurements of channel characteristics, location data or other datathat may be used by the edge device 105 in the processing of videostream 107.

The mobile video device 110 may comprise suitable logic, circuitryand/or code that may be enabled to handle the reception, transmission,processing and/or consumption of multimedia information or data. In anexemplary embodiment of the invention, the mobile video device 110 maycomprise a video enabled wireless telephone or other handheldcommunication device with wireless connectivity via a wireless datacard, wireless tuner, WLAN modem or other wireless link or device thatalone or in combination with other devices may be capable of receivingthe video signal 109 from the wireless access device 104 and storingand/or displaying the video content 106 for a user. In anotherembodiment of the invention, the mobile video device 110 may comprise awired device.

The video content 106 may comprise analog signals such as NationalTelevision System Committee (NTSC), Séquentiel couleur à mémoire (SECAM)or Phase Alternating Line (PAL) coded video signals, or digital videosignals such as Quicktime, (motion picture expert group) MPEG-2, MPEG-4,H.264, or other format, either standard or proprietary that may becarried via an IP protocol such as TCP/IP, Ethernet protocol, Data OverCable Service Interface Specifications (DOCSIS) protocol or otherprotocol.

In operation, the network 102 may distribute information such as videocontent 106 from a video source 100 to a wireless access device 104 forwireless transmission to wireless video devices such as the mobile videodevice 110 or other video devices, for example. The video content 106may comprise movies, television shows, commercials or other ads,educational content, infomercials, or other program content andoptionally additional data associated with such program contentincluding but not limited to digital rights management data, controldata, programming information, additional graphics data and other datathat may be transferred in associated with program content. The videocontent 106 may comprise video with or without associated audio content.The video content 106 may be sent as broadcast video, streaming video,video on demand and near video on demand programming and/or otherformats.

In accordance with an exemplary embodiment of the invention, the edgedevice 105 may receive the video stream 107 from the network 102 mayconvert it from a first format, such as a first digital format used inone portion of the network 102, to another format, such as MPEG-2, H.264or other digital format used to communicate with the wireless accessdevice 104. The wireless access device 104 may communicate the videosignal 109 to the mobile video device 110. In an embodiment of theinvention, the edge device 105 may watermark the video stream 107utilizing GPS information prior to communicating the video signal 109 tothe wireless access device 104. In this manner, the edge device 105 maycontrol which mobile video devices, such as the mobile video device 110,may have access to video data.

FIG. 2 is a block diagram of an exemplary video network, in accordancewith another embodiment of the invention. Referring to FIG. 2, there isshown a video network 200 comprising the video source 100, the network102, the wireless access device 104, an edge device 115, and the mobilevideo device 110. There is also shown the video content 106, a videostream 107, the video signal 109, and mobile device feedback 112. Thevideo source 100, the network 102, the wireless access device 104, andthe mobile video device 110 may be as described with respect to FIG. 1.

The edge device 115 may be substantially similar to the edge device 105,described with respect to FIG. 1, but may be located remotely from thewireless access device 104. While the edge device 115 is shown as beingconnected to, but apart from, the network 102, the edge device 115 maybe considered as part of the network 102, particularly in aconfiguration where the network 102 may be a heterogeneous network andthe edge device 115 comprises an edge router, gateway, or a hub devicethat may convert a video stream 107 from a first format, such as a firstdigital format used in one portion of the heterogeneous network, toanother format, such as MPEG-2, H.264 or other digital format used tocommunicate with the wireless access device 104.

In operation, portions of the network 102 may transport the video signal109 and the mobile device feedback 112 between the edge device 115 andthe wireless access device 104. The video content 106 may comprisemovies, television shows, commercials or other ads, educational content,infomercials, or other program content and optionally additional dataassociated with such program content including but not limited todigital rights management data, control data, programming information,additional graphics data and other data that may be transferred inassociated with program content. The video content 106 may comprisevideo with or without associated audio content. The video content 106may be sent as broadcast video, streaming video, video on demand andnear video on demand programming and/or other formats.

The edge device 115 may receive the video stream 107 and mobile devicefeedback 112 from the network 102 and may convert it from a firstformat, such as a first digital format used in one portion of thenetwork 102, to another format, such as MPEG-2, H.264 or other digitalformat used to communicate with the wireless access device 104 via thenetwork 102. The wireless access device 104 may communicate the videosignal 109 to the mobile video device 110. In an embodiment of theinvention, the edge device 115 may watermark the video stream 107utilizing GPS data prior to communicating the video signal 109 to thewireless access device 104 via the network 102. In this manner, the edgedevice 115 may control which mobile video devices, such as the mobilevideo device 110, may have access to video data.

FIG. 3 is a block diagram of an exemplary video processing system, inaccordance with an embodiment of the invention. Referring to FIG. 3,there is shown a video processing system 125 comprising the wirelessaccess device 104, the mobile video device 110, an edge device 122, anda global positioning satellite (GPS) receiver 124. The edge device 122may be substantially similar to the edge device 105 described withrespect to FIG. 1. There is also shown a video stream 99, the videosignal 109, GPS signals 126, a channel characteristics and/or mobiledevice feedback 144 and RF communication channels 149.

The wireless access device 104 may be as described with respect to FIG.1, but may further comprise a transceiver module 128 and a controlmodule 148. The transceiver module 128 may be enabled to create RFsignals comprising the video signal 109 for transmission to the mobilevideo device 110 via one or more RF communication channels 149. The edgedevice 122 may be enabled to receive the mobile device feedback 112 fromthe mobile device 110 via the wireless access device 104.

The GPS receiver 124 may comprise suitable circuitry, logic and/or codethat may be enabled to receive GPS data from one or more GPS satellitesand may be enabled to determine the edge device 122's position from thereceived GPS data. For example the GPS receiver 124 may determine theedge device 122's position based on ephemeris, signal delay andsatellite position.

The edge device 122, which may be similar to the edge device 105 or 115,may comprise suitable logic, circuitry and/or code that may be enabledto process the video stream 99, such as the video stream 107 or othervideo stream that may comprise the video content 106, described withrespect to FIG. 1, to produce the video signal 109. The processing maybe configured based on the mobile device feedback 112, such that awatermark to be embedded in the video signal 109 may comprise GPS dataof the target wireless device, for example.

In an embodiment of the invention, the edge device 122 may comprisesuitable logic, circuitry and/or code that may enable encoding and/ortranscoding of multimedia data. In an exemplary embodiment of theinvention, the edge device 122 may comprise a video encoder and/or atranscoder that may be implemented using one or more microprocessors,micro-controllers, digital signal processors, microcomputers, centralprocessing units, field programmable gate arrays, programmable logicdevices, state machines, logic circuits, analog circuits, digitalcircuits, and/or any devices that manipulates signals (analog and/ordigital) based on operational instructions that are stored in a memorymodule.

In instances where the edge device 122 may be implemented with two ormore devices, each device may perform the same steps, processes orfunctions in order to provide fault tolerance or redundancy. In anotherembodiment of the invention, the function, steps and processes performedby the edge device 122 may be split between different devices to providegreater computational speed and/or efficiency. The associated memorymodule may be a single memory device or a plurality of memory devices.An exemplary memory device may comprise a read-only memory, randomaccess memory, volatile memory, non-volatile memory, static randomaccess memory (SRAM), dynamic random access memory (DRAM), flash memory,cache memory, and/or any device that stores digital information.

In instances when the edge device 122 may implement one or more of itsfunctions via a state machine, analog circuitry, digital circuitry,and/or logic circuitry, the memory module storing the correspondingoperational instructions may be embedded within, or external to, thecircuitry comprising the state machine, analog circuitry, digitalcircuitry, and/or logic circuitry.

In operation, the edge device 122 may generate the video signal 109 byconfiguring the video stream 99 based on the mobile device feedback 112.In this manner, a video signal 109 may be transmitted to the mobilevideo device 110, via the wireless access device 104, that may beformatted based on the particular characteristics of that device, andmay be adapted to the particular channel conditions, includingauthentication data that may be based on the timing information used bythe mobile communication device or based on its location, for example.The edge device 122 may receive GPS signals 126 from the GPS receiver124, and may also receive channel characteristics 144 and/or the mobiledevice feedback 112. These received signals may be utilized by the edgedevice 122 to generate and embed a customized watermark for the videosignal 109. Additionally, the mobile device feedback 112 may be utilizedto configure the video signal in an appropriate format suitable for themobile video device 110.

The video signal 109, which may comprise an embedded watermark, may thenbe communicated to the wireless access device 104. The wireless accessdevice 104 may be enabled to communicate the video signal 109 to themobile video device 110, and may receive the channel characteristics 144and/or the mobile device feedback 112, which may be communicated to theedge device 122. In this manner, the configuration of the video signal109 may be customized for the mobile video device 110, and may alsoprovide for improved security in instances where the GPS signals 126 maybe utilized to verify that a mobile video device is the targeteddestination device to receive the video signal 109.

FIG. 4 is a block diagram of an exemplary video processing system, inaccordance with another embodiment of the invention. Referring to FIG.4, there is shown a video processing system 125′ comprising the wirelessaccess device 104, the mobile video device 110, an edge device 122′, thevideo source 100, a video encoder 120, and the GPS receiver 124. Theedge device 122 may be substantially similar to the edge device 105described with respect to FIG. 1. There is also shown a video stream 99,the video signal 109, channel characteristics 144 and/or mobile devicefeedback 112 and RF communication channels 149.

The video processing system 125′ may be used in conjunction with thenetwork 102, described with respect to FIG. 1. Notwithstanding, thevideo encoder 120 may comprise suitable circuitry, logic, and/or codethat may enable encoding of a video stream that may comprise the videocontent 106 and generation of the video stream 107. While shown asseparate from the video source 100, the video encoder 120 may beincorporated into the video source 100 or may be downstream of the videosource 100 in the network 102. For instance, the encoder 120 may beincorporated in a head-end, video server, edge router, videodistribution center, or any other network element of the network 102.

The edge device 122′ may comprise suitable logic, circuitry and/or codethat may enable transcoding of information for one format to anotherformat. In an exemplary embodiment of the invention, the edge device122′ may comprise a transcoding module 127 that may generate the videosignal 109 by transcoding the video stream 107 from a watermark (video)format to a second watermark (video) format. The edge device 122′ may beenabled to remove conditional access scrambling and implement a DRM forthe service. The use of the transcoding module 127 may provideadditional flexibility in the edge device 122′ in configuring the videoparameters of the video stream 107 when generating the video signal 109as well as altering the overall format when generating the video signal109.

In operation, the edge device 122′ may mark flows of video content withsource-destination device/user specific watermarks to preventunauthorized distribution of content by enabling the transcoding module127 to insert the watermark in the compressed bit streams. In oneembodiment of the invention, the transcoding module 127 may comprise alayer encoding device that may generate the watermark. The GPS receiver124 may provide the source location info for the watermark. Thedestination/receiving device local info may be provided by the mobilevideo device 110 through the mobile device feedback 112 and such infomay also be a part of the watermark being inserted into the bit streams.The GPS data utilized by the edge device 122′ may comprise exemplaryinformation such as clock, location, vector, and cellular maps forexample.

In another embodiment of the invention, the watermark may be generatedand inserted based on the state of the mobile video device 110 receivedfrom the mobile device feedback 112 to adapt the content format, such asframe rate, color scale or black and white operation, and resolution. Inan exemplary embodiment of the invention, watermarking data may beembedded into the enhancement layer or layers for layered coding. Fortranscoding, the watermark may be inserted into high bit-rate frames toensure robustness and detectability.

Watermark embedding may be considered as a function that involves theoriginal media (content) data {right arrow over (V)}, an embedding key{right arrow over (K)}, a set of parameters {right arrow over (P)} thatcontrol the embedding procedure/algorithm, and a message {right arrowover (M)} that may be embedded in the video and/or audio. The messagedata {right arrow over (M)} may be considered as a sequence of bits. Theset of parameters {right arrow over (P)} may comprise, for example, theso-called watermark embedding factor, i.e. a parameter that controls theamount of degradation that may be inflicted on the original media databy the watermark. The output of the watermark embedding functioncomprise watermarked data {right arrow over (W)}. Thus, the watermarkembedding function may be of the following exemplary form:

{dot over (W)}={right arrow over (∫)}({dot over (V)},{dot over (K)},{dotover (M)},{dot over (P)}).

FIG. 5 is a block diagram of a mobile video device, in accordance withan embodiment of the invention. Referring to FIG. 5, there is shown amobile video device 111 comprising a transceiver module 131, a videoplayer 136, a control unit 150, and a GPS receiver 160. The video player136 may comprise a video display device 140, a video decoder 152, avideo playback module 175, and an input/output (I/O) module 190.

The transceiver module 131 may comprise suitable circuitry, logic,and/or code that may enable receiving RF signals comprising the videosignal 109 and may demodulate and down convert the RF signals to extractthe video signal 109. The video player 136 may comprise the videodecoder 152 that may be enabled to generate a decoded video signal 154for display on the video display device 140, which may comprise a plasmadisplay, LCD display, cathode ray tube (CRT), for example, that eitherdirectly or via projection, creates a video display for an end-user.

In an exemplary embodiment of the invention, the video decoder 152 mayoperate in a plurality of modes of operation. These exemplary modes ofoperation may be selected based on a device parameter 146 received fromthe control unit 150 to conform the decoding of the video signal 109with the device specific watermarking data.

The video decoder 152 may comprise suitable logic, circuitry and/or codethat may be enabled to produce a decoded video signal 154 from the videosignal 109, based on the device parameter 146 provided by the controlunit 150. The device parameter 146 may comprise a processing request (asa part of device parameters), such as requiring a device locationverification. Such a request may be securely stored in the control unit150 of the mobile video device 111, for example. In addition, thecontrol module 147 of the transceiver module 131 may check the devicelocation verification status that may also be provided to an edgedevice, such as the edge device 122′ via mobile device feedback 112,described with respect to FIG. 4, and to the video decoder 152. Thevideo decoder 152 may be enabled to decode the video signal 109 with thewatermark to generate decoded video signal 154 based on the particulardevice parameters 146 and channel characteristics 144.

In instances where the control module 147 of the transceiver module 131may determine that the channel conditions do not support a high qualitysignal, the mobile device feedback 112, may indicate this to the edgedevice 122′, as described with respect to FIG. 4, that may generate thevideo signal 109 to adjust watermarking methods, for example. In thismanner, the video decoder 152 may receive an indication via channelcharacteristics 144 and decode the video signal 109 accordingly.

In another exemplary embodiment of the invention, the control unit 150may determine a state of the video player 136, such as a power state,for example, and may adjust the one or more device parameters 146 inresponse. In this manner, the control unit 150 may control the videodecoder 152 to a lower frame rate, lower color scale or to black andwhite operation, to a reduced resolution and/or to other statecorresponding to a reduced power state that may include reducedprocessor speed and reduced computational abilities, shutting down oneor more MIMO channels of the transceiver 130 or otherwise reducing thereception bandwidth, for example. These changes in reception anddecoding based on the reduced power state may save processing power andhelp increase battery life. The device parameters 146 may be adaptivelyused for the watermark insertion in the edge device to ensure therobustness of watermark.

The video decoder 152 may comprise suitable logic, circuitry and/or codethat may enable generation of one or more decoder feedback parameters149 based on an amount or frequency of decoder errors. The decoderfeedback parameter 149 may be supplied to the control unit 150 and maybe used by the control unit 150 to determine the state of the device andto adjust the one or more device parameters 146 in response. In thismanner, the control unit 150 may configure the video decoder 152 to alower frame rate, lower color scale or to black and white operation, toa reduced resolution and/or to other state to control the decoderfeedback to an acceptable level so that the video player may play thevideo signal 109 in accordance with the these device parameters. Thedecoder feedback 149 may be included in the device parameter 146 thatmay be sent as the mobile device feedback 112 to the edge device 122′.

The video decoder 152 may be implemented in hardware, software and/orfirmware. Various embodiments of the video decoder 152 may beimplemented using one or more microprocessors, micro-controllers,digital signal processors, microcomputers, central processing units,field programmable gate arrays, programmable logic devices, statemachines, logic circuits, analog circuits, digital circuits, and/or anydevices that manipulates signals (analog and/or digital) based onoperational instructions that are stored in a memory module. Ininstances where the video decoder 152 may be implemented with two ormore devices, each device may perform the same steps, processes orfunctions in order to provide fault tolerance or redundancy.Alternatively, the function, steps and processes performed by the videodecoder 136 may be split between different devices to provide greatercomputational speed and/or efficiency. The associated memory module maybe a single memory device or a plurality of memory devices. Such amemory device may be a read-only memory, random access memory, volatilememory, non-volatile memory, static random access memory (SRAM), dynamicrandom access memory (DRAM), flash memory, cache memory, and/or anydevice that stores digital information. In instances where the videodecoder 152 may implement one or more of its functions via a statemachine, analog circuitry, digital circuitry, and/or logic circuitry,the memory module storing the corresponding operational instructions maybe embedded within, or external to, the circuitry comprising the statemachine, analog circuitry, digital circuitry, and/or logic circuitry.

The mobile video device 111 may comprise a GPS receiver 160. The GPSreceiver 160 may comprise suitable logic, circuitry and/or code that maybe enabled to receive and/or generate the GPS data 162 that may becommunicated to the edge device 122 as the mobile device feedback 112for watermarking and optionally used by the video decoder 152 forauthentication of the video signal 109. The GPS clock signal 164 may beused as a global clock signal for synchronizing the timing of the mobilevideo device 111 and the edge device 122, and for controlling the timingof the decoding and playback of video signal 109. The presence of theGPS receiver 160 and/or the receipt of current GPS data 162 or GPS clocksignals 164 may be used by the mobile device 111 to trigger mobiledevice feedback 112 sent to edge device 122, as shown in FIG. 3, thatindicates the availability of GPS data in the mobile device 111 for thepurposes of timing and/or authentication.

The location data received via mobile device feedback 112 as describedwith respect to FIG. 3, may be used to generate location-basedauthentication data that may be embedded in the video signal 109 as apart of the watermark. The video decoder 152 may comprise anauthentication routine that compares the location data from theauthentication data of the video signal 109 to its own location data,such as GPS data 162 generated by GPS receiver 160. If the location dataincluded in the authentication data compares favorably to the GPS data162, the video signal 109 may be authenticated and the playback of videosignal 109 by mobile video device 110 may be enabled. In instances wherethe location data included in the authentication data varies from theGPS data 162 by more than an authentication threshold such as 1 mile, 5miles or some greater or lesser distance based on the desired level ofsecurity, the playback of the video signal 109 by the mobile videodevice 111 may be disabled.

The mobile video device 111 may comprise an I/O module 190 and a videoplayback module 175 comprising a memory 180 and a processing module 182that may execute an application for storing selected video signals 109as a plurality of stored video files and playing back these video files.The I/O module 190 may comprise a user interface module comprising oneor more buttons, a keyboard, keypad, a click wheel, touch screen, amicrophone, speaker and/or other user interface devices for example,that allow the video playback module 175 to interact with the user byproviding prompts either directly or via screen displays that aregenerated by the video playback module 175 and displayed on the videodisplay device 140, to receive commands and other interface data 192 inresponse to actions of a user of mobile video device 111.

In an embodiment of the invention, the processing module 182 may performthe watermark detection/verification and may be implemented using one ormore microprocessors, micro-controllers, digital signal processors,microcomputers, central processing units, field programmable gatearrays, programmable logic devices, state machines, logic circuits,analog circuits, digital circuits, and/or any devices that manipulatesignals (analog and/or digital) based on operational instructions thatare stored in a memory module, such as the memory 180. In instanceswhere the processing module 182 may be implemented with two or moredevices, each device may perform the same steps, processes or functionsin order to provide fault tolerance or redundancy. Alternatively, thefunction, steps and processes performed by the processing module 182 maybe split between different devices to provide greater computationalspeed and/or efficiency. The associated memory module may be a singlememory device or a plurality of memory devices. Such a memory device maybe a read-only memory, random access memory, volatile memory,non-volatile memory, static random access memory (SRAM), dynamic randomaccess memory (DRAM), flash memory, cache memory, and/or any device thatstores digital information. In instances where the processing module 182may implement one or more of its functions via a state machine, analogcircuitry, digital circuitry, and/or logic circuitry, the memory modulestoring the corresponding operational instructions may be embeddedwithin, or external to, the circuitry comprising the state machine,analog circuitry, digital circuitry, and/or logic circuitry.

In operation, the video playback module 175 may receive commands from auser to store a video signal 109 as a digital video file in memory 180.The user may also navigate through stored video files and select astored video file for playback. During playback, the processing module182 may convert the stored video file to a video signal that may beprovided to the video decoder 152 that generates a decoded video signal154 for display on the display device 140. The I/O module 190 mayprovide one or more exemplary control buttons comprising play, stop,pause, fast forward, rewind, slow motion, and may generate interfacedata 192 used by processing module 182 to control the playback of astored video file in response to user commands. Additionally, the videoplayback module 175 may generate navigation data for each stored videofile that may be used in a video navigation routine that allows a userto select a stored video file for playback based on the navigation dataand based on interface data 192 generated in response to the action of auser.

FIG. 6 is a block diagram illustrating a watermarking system in a mobilevideo device, in accordance with an embodiment of the invention.Referring to FIG. 6, there is shown the edge device 122′, a smart card603 and a DRAM 605. The edge device 122′ may comprise a conditionalaccess (CA) descrambler 607, a one-time programmable (OTP) memory 609, acombinational function block 611, a watermark message parser 613, anembedded CPU 615, a time stamp counter 616, a watchdog timer 617, a mainCPU 619, a copy protection (CP) scrambler 621, a CP descrambler 627, avideo decoder 629 and a watermark detector 631. There is also showninput and output signals, namely, video in 641 and video out 643,respectively. The edge device 122′ may be as described with respect toFIG. 4

The DRAM 605 may comprise suitable circuitry, logic and/or code that mayenable storage of code to be used by the CPU 619 for control of the edgedevice 122′. The DRAM 605 may also comprise the compressed data 623 andthe descriptors 625. The compressed data 623 region of the DRAM 605 maycomprise compressed and watermarked video data, and the descriptor 625section of the DRAM 605 may comprise data that may be utilized by thewatermark detector 631 to determine the location of the watermarks toverify that the watermarks were properly inserted. The compressed data623 and the descriptors 625 may not be accessed by the main CPU 619, andmay only be accessed by the embedded CPU 615, which may enhance systemsecurity.

The smart card 603 may comprise suitable circuitry, logic and/or codethat may enable storage of data for the descrambling of the receivedvideo in 641. The data stored in the smart card 603 may comprise CAdescrambling keys or service provider specific data, for example.

The CA descrambler 607 may comprise suitable circuitry, logic and/orcode that may enable conditional access descrambling of received videosignals. The CA descrambler may receive as inputs the input signal,video in 641, data stored in the smart card 603 and unique identifierdata stored in the OTP 609. Video signals may be CA scrambled by aservice provider to control access to content to authorized users only.

The OTP memory 609 may comprise suitable circuitry, logic and/or codethat may enable storage of unique identifier data specific to the edgedevice 122′, such that an embedded watermark may comprise informationabout the source and/or destination of the data. Additionally, the OTPmemory 609 may store keys to be utilized by the CA descrambler 607.

The combinational function block 611 may comprise suitable circuitry,logic and/or code that may enable combining, or scrambling of uniqueidentifier data stored in the OTP 609 with a combinatorial function. Theresulting unique ID 635 may be communicated to the embedded CPU 615 tobe included in the watermark inserted into the video data.

The watermark message parser 613 may comprise suitable circuitry, logicand/or code that may enable “snooping” data from the CA descrambler 607to detect watermarking messages that may be in the video data stream. Inan exemplary embodiment of the invention, the watermark message parser613 may comprise hardware, as opposed to software, to reduce and/oreliminate the ability of a hacker to interfere with the detection ofwatermarking messages. The watermark message parser may generate atrigger signal 637, which may trigger the embedded CPU 615 to initiate awatermark insertion process.

The embedded CPU 615 may comprise suitable circuitry, logic and/or codethat may enable control of the watermark embedding process. The embeddedCPU 615 may be entirely separate from the main CPU 619 so that softwarecode from third parties, or hackers, may not affect the watermarkembedding process. Accordingly, the embedded CPU 615 may utilize signedcode only, which may prevent modification of the code by external means.

In addition to signing the code of the embedded CPU 615, the code mayalso be stored externally encrypted, in order to prevent exposing thewatermark insertion or extraction algorithm. In such a case, the code ofthe embedded CPU 615 may be decrypted on-chip, then stored in a regionof the DRAM 605 which may only be accessible to the embedded CPU 615,and off-limits to other processors. Storing the data in a non-CPUaccessible region may help prevent theft of pre-watermarked data ininstances where the watermark insertion occurs on the decompressed data.Furthermore, the DRAM 605 contents may only be written to DRAM inscrambled form, in order to prevent pin snooping which may reveal thecontents of the embedded CPU code, or other sensitive watermark andnon-watermark related parameters. The embedded CPU 615 may generate andinsert the watermark 639 in the video data received from the CAdescrambler 607.

In an embodiment of the invention, the embedded CPU 615 may receive theGPS signal 126 as an input and may incorporate GPS data into thewatermark 639. In another embodiment of the invention, the embedded CPU615 may insert the descriptors 625 in the DRAM 605, which may beutilized by the watermark detector 631 to identify the location of thewatermarks in the video data and verify that they were properlyinserted. The descriptors 625 may not be accessed by the main CPU 619,thus increasing the security level of the edge device 122′.Additionally, the embedded CPU 615 may be enabled to insert watermarkvideo before or after storage in the compressed data 623 of the DRAM605.

The time stamp counter 616 may comprise suitable circuitry, logic and/orcode that may enable insertion of the time-of-day and date informationinto the watermark itself, so that a suspect stream may be analyzed tosee when it was recorded.

The watchdog timer 617 may comprise suitable circuitry, logic and/orcode that may detect whether the embedded CPU 615 may be functioning andresponding to interrupts from the watermark message parser 613. Ininstances where the watchdog timer 617 may determine that the embeddedCPU 615 may be incorrectly configured or enabled by an unauthorizedentity, the edge device 122′ may be disabled. Accordingly, the watchdogtimer 617 may require a watermark insertion interrupt periodically. Ifenough time elapses without seeing a watermark insertion interrupt, thenthe system may be considered “hacked”, and the watchdog timer 617 mayreset the chip, or take other action which makes the edge device 122′unusable.

The main CPU 619 may comprise suitable circuitry, logic and/or code thatmay enable overall functional control of the edge device 122′. The mainCPU 619 may access the DRAM 605, but may not have access to thecompressed data 623 or the descriptors 625 in the DRAM 605. For example,the main CPU 619 may be utilized to update and/or modify programmableparameters and/or values in a plurality of components, devices, and/orprocessing elements in the edge device 122′.

The CP scrambler 621 may comprise suitable circuitry, logic and/or codethat may enable scrambling the watermarked signal before storing in thecompressed data 623 section of the DRAM 605. The CP scrambler mayenhance security of the system by reducing and/or eliminating a hacker'sability to intercept unscrambled video, and may comprise an optionalsystem component, depending on the security requirements of the edgedevice 122′. In instances where the watermark may be inserted in videoafter being read from the compressed data 623 and before the videodecoder 629, scrambling the data to be stored in the DRAM 605 mayprevent the theft of pre-watermarked data.

The CP scrambler 627 may comprise suitable circuitry, logic and/or codethat may enable descrambling of CP scrambled data. In instances wherethe CP scrambler may have been utilized to CP scramble the video signalreceived from the CA descrambler 607, the CP descrambler may be utilizedto descramble the signal before communicating the signal to the videodecoder 629.

The video decoder 629 may comprise suitable circuitry, logic and/or codethat may enable decoding a video for display. In instances where awireless mobile device, such as the wireless device 111 may comprise avideo decoder, such as the video decoder 152, both as described withrespect to FIG. 5, the video decoder 629 may not be necessary. Inanother embodiment of the invention, the video decoder 629 may comprisean embedded CPU 615A for embedding a watermark into the video signal.The video decoder 629 may receive as an input the compressed data 623stored in the DRAM 605, or from the CP descrambler 627 when implementedto descramble a CP scrambled signal and generate an output signal, videoout 643.

The watermark detector 631 may comprise suitable circuitry, logic and/orcode that may enable detecting the watermark 639 embedded in the videosignal by the embedded CPU 615. By comparing the measured watermark tothe descriptors 625 stored in the 625, the watermark detector 631 mayverify the proper functioning of the watermark process in the edgedevice 122′.

In operation, a CA scrambled signal may be communicated to the CAdescrambler 607. The descrambler 607 may utilize descrambling keysand/or unique identifier data from the smart card 603 and the OTP memory609 to descramble the input signal, video in 641. The descrambled signalmay be parsed by the watermark message parser 613 to determine whether awatermark may be required to be inserted into the video data.

The watermark message parser 613 may generate a trigger signal 637 toenable the embedded CPU 615 to insert a watermark in to the descrambledvideo signal generated by the CA descrambler 607. The embedded CPU 615may receive the unique ID 635 from the combinational function block 611to generate a watermark 639 that may be specific to the edge device122′. In addition, GPS data may be communicated to the embedded CPU 615via the GPS signal 126, so that the watermark 639 may comprise locationinformation. In this manner, pirated content may be traced back to theedge device that may have generated the data. The embedded CPU 615 mayalso store the descriptors 625 in the DRAM 605 for watermarkverification by the watermark detector 631.

The watermark messages may be encrypted, and may require an extradecryption step after the CA descrambling. This may prevent exposed CAdescrambled data from compromising the underlying messaging andwatermarking algorithm, since as soon as the watermark messages may bedecrypted they may be removed from the stream. In an alternativeembodiment, the watermark messages may be removed and then decrypted.

In instances where CP scrambling may be desired prior to storage, thevideo signal with the watermark 639 inserted may be communicated to theCP scrambler 621. The resulting scrambled signal may be stored as thecompressed data 623 in the DRAM 605. In instances where CP scramblingmay not be required, the watermarked video signal may be stored directlyas the compressed data 623 in the DRAM 605.

In instances where the CP scrambler 621 may have CP scrambled thewatermarked video signal, the compressed data 623 in the DRAM 605 may becommunicated to the CP descrambler 627. The resulting descrambled signalmay be received by the video decoder 629 and the watermark detector 631.The watermark detector 631 may utilize the descriptors 625 in the DRAM605 to verify the watermark detected in the watermarked video signal. Ininstances where the watermark detector 631 determines that the watermarkdetected in the watermarked video signal may not match the descriptors625 in the DRAM 605, the edge device 122′ may be disabled.

FIG. 7 is a flow diagram of an exemplary video transmission andwatermarking process, in accordance with an embodiment of the invention.The exemplary steps may begin with step 703, where video content may becommunicated from a video source via a network to an edge device. Instep 705, GPS data may also be received by the edge device. In step 707,a watermark comprising GPS data may be embedded in the video data,followed by step 709 where the video signal may be communicated to awireless access device. Additionally, a mobile device feedback signalmay be communicated back to the edge device. In step 711, the videosignal may be communicated to a mobile video device, followed by step713, in which the watermark may be extracted and the mobile devicefeedback signal may be communicated back to the edge device via thewireless access device. In step 715, in instances where the watermarkdata passed verification, the video data may be displayed in step 717,followed by end step 721. If the verification fails, the exemplary stepsmay proceed to step 719 where the display of the video on the mobilevideo device may be disabled, followed by end step 721.

In an embodiment of the invention, a method and system are disclosed forwatermarking data at a communication device 122 utilizing receivedglobal positioning (GPS) data 126 and communicating the watermarkedvideo data 109 from the communication device 122 to a receivingcommunication device 110. The receiving communication device 110 mayverify the watermarked data 109. The receiving communication device 110may determine whether to render the received watermarked data 109 basedon the verification. The watermarked data 109 may comprise multimediainformation comprising voice, video and/or text information. Thecommunication device 122 may comprise an edge device. The receivingcommunication device 110 may comprise a wired and/or a wirelesscommunication device. The communication device 122 may receive afeedback signal 112 communicated from the receiving communication device110. The watermarking of subsequently processed data may be adjustedbased on the received feedback signal 112. The feedback signal 112 maycomprise GPS data and/or device parameters corresponding to thereceiving communication device 110. The device parameters may compriseone or more of: a power state, a device resolution, a screen size and adisplay setting of the receiving communication device. The watermarkedvideo data 109 communicated to the receiving communication device 110may be adjusted based on one or more device parameters corresponding tothe receiving communication device 110 and/or GPS informationcorresponding to the receiving communication device 110. Thecommunication device 122 may transcode data corresponding to thewatermarking from a first format to a second format.

Certain embodiments of the invention may comprise a machine-readablestorage having stored thereon, a computer program having at least onecode section for video transmission and processing with customizedwatermarking delivery, the at least one code section being executable bya machine for causing the machine to perform one or more of the stepsdescribed herein.

Accordingly, aspects of the invention may be realized in hardware,software, firmware or a combination thereof. The invention may berealized in a centralized fashion in at least one computer system or ina distributed fashion where different elements are spread across severalinterconnected computer systems. Any kind of computer system or otherapparatus adapted for carrying out the methods described herein issuited. A typical combination of hardware, software and firmware may bea general-purpose computer system with a computer program that, whenbeing loaded and executed, controls the computer system such that itcarries out the methods described herein.

One embodiment of the present invention may be implemented as a boardlevel product, as a single chip, application specific integrated circuit(ASIC), or with varying levels integrated on a single chip with otherportions of the system as separate components. The degree of integrationof the system will primarily be determined by speed and costconsiderations. Because of the sophisticated nature of modernprocessors, it is possible to utilize a commercially availableprocessor, which may be implemented external to an ASIC implementationof the present system. Alternatively, if the processor is available asan ASIC core or logic block, then the commercially available processormay be implemented as part of an ASIC device with various functionsimplemented as firmware.

The present invention may also be embedded in a computer programproduct, which comprises all the features enabling the implementation ofthe methods described herein, and which when loaded in a computer systemis able to carry out these methods. Computer program in the presentcontext may mean, for example, any expression, in any language, code ornotation, of a set of instructions intended to cause a system having aninformation processing capability to perform a particular functioneither directly or after either or both of the following: a) conversionto another language, code or notation; b) reproduction in a differentmaterial form. However, other meanings of computer program within theunderstanding of those skilled in the art are also contemplated by thepresent invention.

While the invention has been described with reference to certainembodiments, it will be understood by those skilled in the art thatvarious changes may be made and equivalents may be substituted withoutdeparting from the scope of the present invention. In addition, manymodifications may be made to adapt a particular situation or material tothe teachings of the present invention without departing from its scope.Therefore, it is intended that the present invention not be limited tothe particular embodiments disclosed, but that the present inventionwill include all embodiments falling within the scope of the appendedclaims.

1. A method for digital media processing, the method comprising:watermarking data at a communication device utilizing received globalpositioning (GPS) data; and communicating said watermarked video datafrom said communication device to a receiving communication device. 2.The method according to claim 1, wherein said receiving communicationdevice verifies said watermarked data.
 3. The method according to claim2, wherein said receiving communication device determines whether torender said received watermarked data based on said verification.
 4. Themethod according to claim 1, wherein said watermarked data comprisesmultimedia information comprising voice, video and/or text information.5. The method according to claim 1, wherein said communication devicecomprises an edge device.
 6. The method according to claim 1, whereinsaid receiving communication device comprises a wired and/or a wirelesscommunication device.
 7. The method according to claim 1, comprisingreceiving at said communication device, a feedback signal communicatedfrom said receiving communication device.
 8. The method according toclaim 7, comprising adjusting watermarking of subsequently processeddata based on said received feedback signal.
 9. The method according toclaim 7, wherein said feedback signal comprises GPS data and/or deviceparameters corresponding to said receiving communication device.
 10. Themethod according to claim 9, wherein said device parameters comprise oneor more of: a power state, a device resolution, a screen size and adisplay setting of said receiving communication device.
 11. The methodaccording to claim 1, comprising adjusting said watermarked video datacommunicated to said receiving communication device based on one or moredevice parameters corresponding to said receiving communication deviceand/or GPS information corresponding to said receiving communicationdevice.
 12. The method according to claim 1, comprising transcoding viasaid communication device, data corresponding to said watermarking froma first format to a second format.
 13. A system for digital mediaprocessing, the system comprising: one or more circuits in acommunication device that watermarks data at a utilizing received globalpositioning (GPS) data; and said one or more circuits communicates saidwatermarked data from said network to a receiving communication device.14. The system according to claim 13, wherein said receivingcommunication device verifies said watermarked data.
 15. The systemaccording to claim 14, wherein said receiving communication devicedetermines whether to render said received watermarked data based onsaid verification.
 16. The system according to claim 13, wherein saidwatermarked data comprises multimedia information comprising voice,video and/or text information.
 17. The system according to claim 13,wherein said communication device comprises an edge device.
 18. Thesystem according to claim 13, wherein said receiving communicationdevice comprises a wired and/or a wireless communication device.
 19. Thesystem according to claim 13, wherein said one or more circuits enablesreceiving by said communication device, a feedback signal communicationfrom said receiving communication device.
 20. The system according toclaim 19, wherein said one or more circuits enables adjustment ofwatermarking of subsequently processed data based on said receivedfeedback signal.
 21. The system according to claim 19, wherein saidfeedback signal comprises GPS data and/or device parameterscorresponding to said receiving communication device.
 22. The systemaccording to claim 21, wherein said device parameters comprise one ormore of: a power state, a device resolution, a screen size and a displaysetting of said receiving communication device.
 23. The system accordingto claim 13, wherein said one or more circuits enables adjustment ofsaid watermarked video data communicated to said receiving communicationdevice based on one or more device parameters corresponding to saidreceiving communication device and/or GPS information corresponding tosaid receiving communication device.
 24. The system according to claim13, wherein said one or more circuits enables transcoding of datacorresponding to said watermarking from a first format to a secondformat.